Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test queue size latest latency #652

Draft
wants to merge 8 commits into
base: main
Choose a base branch
from

Conversation

haixuanTao
Copy link
Collaborator

@haixuanTao haixuanTao commented Sep 10, 2024

Example of error that I will probably need @phil-opp to help me on, which is that the dora queue_size keeps one old message in the queue and not drop all oldest input.

We need to revise our different queues of inputs and make sure to only store the latest input.

This happens in both rust and python, I have added one example of each.

To test

dora start tests/queue_size_latest_data_python/dataflow.yml

cargo build -p receive_data --release
dora start tests/queue_size_latest_data_rust/dataflow.yml

Base automatically changed from qwenvl2 to main September 17, 2024 07:19
haixuanTao added a commit that referenced this pull request Oct 13, 2024
In order to get the best performance from Qwenvl2, we need to temporary
add this piece of code that is going to unqueue qwenvl queue.

This is directly linked to: #652
which is that we currently having a queue issue within nodes for
`queue_size: 1` where the queue is actually pending older data and not
the newest one.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants